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ABSTRACT 

Since few debate tournaments can be administered 
successfully without employing some hi red- judge pool, one of the 
fundamental ethical concerns facing the tournament director is the 
balance between filling all judge responsibilities and securing 
competent judges, '''he responsibility of securing competent judges can 
be mec through a more extensive training program for each individual 
who will serve as a hired judge. A fif^^ninar conducted by the 
tournament director might include ut the very least a discussion of 
the rules and, in the case of individual events, a review of each 
description. The specific ballot should be explained in detail, as 
well as the liignif icance of each aspect. Rather than influence 
judges' personal judging philosophy, the fairest approach would be to 
present the major viewpoints held in each area and then recommend 
that bach judge determine his or her own standards. Also, providing 
judges with an opportunity to watch host school competitors perform 
the various events, coupled with a generalized critique by the 
tournament director, should provide a clearer understanding of the 
activity. Extresie care must be taken to ensure that hired judges who 
are familiar with host school competitors are kept cut of rounds 
involving these students, finally, coaches should provide validation 
to all ballots, whether from hired judges or not, so that students 
are made aware that the worth of each opinion and comment rests in 
tche content, not in the author. (HTH) 
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ABSTRACT FOR 
THE USE AND ABUSE OF THE 
HIRED JUDGE POOL 
BY 

MICHAEL T. NICOLAI 

r\I Securing an adequate number of competent hired judges can pose major problems 

^ for forensics tournament directors. Most of the concerns center on the com- 



o 



petency of judges who are not directly involved in forensics oa a v/eekly (or 
even daily) basis. This paper investigates several questions associated with 
this concern. 

Initially an effort is made to identify the specific criticisms that are dir- 
ected toward hired judges, followed by an analysis of how such critical concerns 
may have developed. In response to these concerns suggestions are offered to 
aid directors in providing individuals who are better prepared to serve as 
judges. 

Finally, the paper addresses a most critical question concerning the overall 
attitude toward "lay" judges. 



U J. DEMflTMENT OF EDUCATION 

NATIONAL INSTITUTE OF EOOCATIOl^ 

EDUCATIONAL RESOURCES INFORMATION 
CENTER (ERIC) 
Ths document has been reproduced at 
recefved from the person or orflanization 
nrigir>ating it 
I J Minor changes have been made to improve 
reproduction quality 

• Point! of view or opinions stated in th« docu 
ment do ot necessanty represent official NIE 

position or policy 




"PERMISSION TO REPRODUCE THIS 
MATERIAL H\S BEEN GRANTED BY 

Michael T. Nicolai 



TO THE EUUCATIur^Al rtESOUt^CES 
INFORMATION CENTER (ERIC)" 



The Use and Abuse of The 
Hired Judges Pool 
Michael T. Nicolai 
University of Wisconsin-Stout 
Speech Communication Convention 
November 10th 1985 

They have beei called every name in the book from hired killer to pro- 
fessional squirrel, j ^ are the subject of nightmares for serious competitors, 
they can be the scourge of a tournament director's life, and they are an essen- 
tial element of almost every forensic tournament. The hired judge has been one 
of the more frequent topics of discussion during those long rides home after al- 
most any forensic contest. Questions ranging from "What do I do about this eval- 
uative comment?" to "How could he/she have made that decision about my performance?" 
to "Was the judge from this planet?" have bounced about the interiors of university 
vans for years e It does seem that the adjective "hired" when placed before the 

"judge" causes a wide spectrum of attitudes, most of whici are negative, from 
c^cxches and competitors alike. The intent of this paper is to explore both the 
reasons behind such attitudes and to discuss the ethical and educational impact of 
such beliefs. Upon preliminary investigation, the two primary areas to focus on 
should be the approach taken by tournament directors in usl hired judges and the 
attitude coaches and students take toward the ballots received from hired judges. 
It might well be that the ultimate ethical question is found in this second concern. 

As noted in the opening comments, few tournaments can be successfully admini- 
stered without employing some hired judge pool. Particularly in individual everts 
tournaments, guest schools often cannot supply an appropriate judging staff to meet 
their entry co^nmitments. In both debate and indivic^ual events competition, the task 
of judge assignment is aided by an adequate pool of judges v.^th no school alliances. 
Anyone who has scheduled a tournament is j^ainfull^^ aware of the fact that placing 
judges often takes as much time as setting the panels for competitors. Tn many 
instances, the depth of the hired judge pool w'^l determine the difficulty or ease of 
the judge assignment process, as well as the ^eight of judging responsibility for 



coaches attending the tournament. RealizatiL/n of this fact of tournament management 
forces many tournament directors to scour the countryside for any and all persons 
who might be competent to serve as judges. As the tournament draws closer, the 
operational definition of competency may broaden considerably. A survey of ^^id- 
western forensic directors recently suggested that tournament directors use between 
three and twenty hired judges at each tournament they administer. Such a demand can 
prove difficult to meet while still restricting the pool to only those persons well 
versed and experienced in the unique aspects of debate and individual events. When 
adding the variable that at many tournaments (especially individual events tourna- 
ments) a full-time hired judge may judge as many as nine preliminary and two elimi- 
nation rounds (based on survey results) > it is easy to see the impact the hired 
judge pool can have on each tournament. 

One of the fundamental ethical concerns facing the tournament director is the 
balance between filling all judge responsibilities and securing individuals who will 
provide educationally and evaluatively sound judgements and comments. This concern 
has often been simplified to the competent judge vs. "warm body" dilemma. Again, 
based on the limited survey results, it appears that some concern exists that many 
hired judges fall intc the "warm body" category. When asked tc indicate concerns 
about hired judges, forensic coaches responded with comments such as "seemed inex- 
perienced," "unfamiliar vith rules," "made inappr i^priate comments," "didn't under- 
stand criteria," and "not respected by students." Given such comments and the 
weekly discussions the forensic community seems to have about hired judge's compe- 
tency, it would seem that tournament administrators need to look more closely at 
the approach they take in securing, assigning, and, more importantly, training the 
hired judge pool. 

It would seem that the primary responsibility to provide judges who will 
benefit the educational growth of the student competitor can best be met through a 
more extensive training program for each individual who will serve as a hired judge. 
When tournament directors were asked to explain the training that is given to po- 



tential hired judges, the overwhelming response was, "A copy of the rules is pro- 
vided." Judging 3 debate or individual event is a demanding activity, and it would 
seem that judges, especially those with little or no previous forensic experience, 
need to be armed with more than a set of rules and their own communication skills. 
A brief look at a typical scenario might suggest one of the reasons hired judge 
ballots are singled out as being weak or lacking credibility. 

On Saturday morning a hired judge arrives at the tab room to pick 
up his assignment. The tournament director, rushing to get roois 
unlocked stops to give the assignment sheet to the judge. "What 
is CA?" the judge asks. As the director Is about to explain, his 
student announces that two judges haven^t shown up. With controlled 
frenzy the director says, "Oh, it's just a siL.ple analysis of a rhe- 
torical evept. Judge it like a persuasive." With a pat on the back 
the director shoves the hired judge, who is the theatre director at 
the high school, off to judge his first communication analysis. 

While the example may contain exaggeration for the sake of demonstration, the 
basic event is unfortunately repeated more often than tournament directors might 
like to admit. It is of little surprise that a hired judge may not provide the 
most educationally useful ballots. 

Correcting this inadequacy is actually theoretically simple, although some- 
what demanding for both the tournatient director and the hired judge. Prior to the 
tournament, a judging seminar should be conducted by the director. The seminar 
should include at the very least a discussion of the rules and, in the case of indi- 
vidual events, a review of each description. The specific ballot which will be used 
should be explained in detail, indicating the significance of each aspect. It is 
interesting to note that when asked what were the problems hired judges caused 
tournament administrators, the number one response was "errors on the ballot." 

After this information has been provided, another ethical question arise, 
namely, "How specific an explanation of judging criteria should be provided?" 
There is a legitimate concern over imposing or influencing judges with regard to 
personal judging philosophy. Questions of literary merit or significance of prima 
facia, foi example, begin to edge into individualized judging standards which 
really should be left to the discretion of each judge. Yet some hired judges may 
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not be aware of the need to address such items. How far training should go in 
this area does present a dilemma for the tournament director. It would seem 
that the fairest approach would be to present the major viewpoints held on each 
area and then recommend that each judge determine his/her own standard. Pro- 
viding representative ballots that host school competitors have received might 
prove helpful in this area. 

One final suggestion concerning training is to provide the judge with the 
opportunity to watch host school competitors perform the various events. This, 
coupled with a generalized critique by the tournament director, should provide a 
clearer understanding of the acti/ity. 

Obviously such a training program places a tir^z demand on potential judges, 
as well as on the already harried tournament director. However, given the ethical 
responsibility to the student, the demand does not seem unrealistic. Perhaps the 
demand could be softened by paying the hired judge the equivalent of the stipend 
for one round of judging for attending the session. 

One last o*"hical coacern exists for the director whose students compete at 
their own tournament. Extreme care must be taken to ensure that hired judges who 
are familiar with host school competitors are kept out of rounds involving these 
students. This fact should be obvious to each director. However, beyond this, 
care should be taken so that hired judges who appear "clean" (f^ from affiliation 
bias) are in reality able to judge any and all competitors. A director may think 
the**- a local judge couldn't know any of the host school competitors, but the reality 
of the situation might be different. 

To this point, this paper has centered on the ethical concerns for the tourn- 
ament director regarding hired judges. Vhere are some observations fnat can be made 
about hired judges from a coach's viewpoint, and these might well touch upon some 
fundamental ethical corxerns of the overall forensic activity. It is interesting 
that the title of this paper is "The Use and Abuse of Hired Judges." Often the 
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hired judge is not the abuser but the abused. As noted in the introductory 
comments, hired judges are often the object of outright scorn. Looking back at 
the survey comments concerning problems with hired judges, perhaps the most dis- 
turbing was that hired judges are "not respected by the students." It might be 
that coaches need to examine their approach to evaluating the decisions and 
comments received by hired judges. Based on discussions with coaches, it seems 
that all too often there is a tendency to dismiss the hired judge decision and/ or 
comments if they seem to deviate from the norm. This is especially the case when 
a decision in debate or a ranking in an individual events round goes against the 
team or individual who "snould" win based on previous performance. When a judge, 
hired or otherwise, is considered "wrong" in his/her comments, it seems that a 
very basic foundational coacept of communication has been violated by the reviewer. 
The rankings and comraents on a ballot reflect the opinion of a judge and as such 
should not (cannot) be subjected to challenges of correctness. An opinion is just 
that, a feeling or attitude; it may not reflect the norm, but that does not auto- 
matically dismiss it as being of little or no worth. 

It m^ght well be that the hired judge through his/her "deviant" ballots is 
exposing some potential problems with forensic competition. The cornerstone of 
forensics activity is to improve communication skills through healthy competition. 
Is it possible that debate and individual events have become so specialized that 
they have a set of communication rules that do not reflect "real world" communication 
standards? And if this is the case, should the forensics community be concerned 
over the impl-Jcation of this? If a major goal of forensics is to better prepare 
student competitors for their roles in society, then it would seem that this would 
be reflected in standards readily apparent co all who observe forensic performances. 
Reaction to deviant rankings/decisions by hired judges may be signalling another 
ethical concern for forensic educators. Is it possible that the reputation of the 
competitor receives too much weight in tht- evaluative process by "regular Judges?" 
Just as in professional baseball where the strike zone gets smaller for some super- 
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Stars, do some forensic "heavy hitters" get an unfair advantage of the doubt too 
often? Judging should be based on the current performance, not overall track 
record. It just might be that the person who judges once a year aud is seeing 
everyone for the first time is providing as realistic an assessment of the com- 
petition as is the veteran judge. 

Given the possibilities just discussed, it would seem that coaches should, 
at the very least, provide validation to all ballots, whether from hired judges 
or not. It seems crucial that students be made aware that the worth of each 
opinion and coimnent rests in the content, not in the author. It might be useful 
for forensic directors to consider the subtle message that is sent when we find 
that hired judges deviate from the norm. 

Tournament administration tests every resource a director has to call upon. 
Between making certain the schedule is error free and the morning donuts are 
fresh, there are a thousand and one items that demand the skill, attention, and 
confident calm that only a forensic director has. But added to the list of "to 
do's" should be a deliberate and well-thought- through training system for those 
who give their time and talent to serve as hiiod judges. 

As coaches, it might be wise to give a little more openminded attention to 
those ballots signed "hired juage." 
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